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ABSTRACT v ' 

Bayesian data analytic procedures were used to assess 
the e*ffect£ of a new undergraudate advisingorogram designed to focus 
on students who do not initially decl^r^ f> a"'may5 v r field of study. Bast 
research has shown that these sttpietfifs tend to graduate, at a low 
rate, relative to those e who a^. declare majors,- It was hypothesized 
that these students' also perform less well on the average taan those' 
whQ do declare majors. .Or>particular concern were high-ability, 
"undecided" students. Three! criteria w*ere used to evaluate the 
advising program: first- semester dropout rate, first-year dropout 
'rafe-, and first-semester grade point average (GPA) , iwo samples of 
highrability (AfcT Composite greater than ,25), undecided freshmen, 
coming ,from two entering class cohorts, were used in the study* One 
grou^p was included in the new prograto; the other was advased in the . 
traditional toanner. The results of the study were mixed, depending on 
the criterion of choice. Given the selected priors and loss function, 
analysis with first-year dropout rate as y t he criterion was supportive 
of the program, whereas analyses with tile other criteria were not* It 
is suggested that a similar analysis with second-semester GPA as 4 ihe 
criterion, cduld fufther examine the effectiveness of/the program for 
high ability, undecided students. It is also .suggested that the 
effects of the new advising program are not fully seen until the 
second -semester of the freshmen year. Wutljor/LB) . 
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ABST.B1CT 

Bayesian data analytic procedures' nere~<used to assess v 

the effects of a new undergraduate advising program, de- 

signed to focus on students who do not initially declare a 

major field of study. Past research has shown that these 

students tend to graduate at a. low rate, relative to those 

t ( . 
who do declare .majors. Additionally, it was hypothesized 

that these students -perform less well on the average than 
-those who do declare majors. -Of particular , concern were 
high-ability, "undecided" students. Presumably, they were 
performing less well/ and perhaps dropping out, for Reasons 
pther than inability to do college7level work. ^Thi's, study 
was planned to pairtially evaluate the prograp ttsing three 
criteria: f i£st-semester dropout rate, first-year dropout • 
rate, and f iifst-semester GkA. Two samples of 'high-ability 
(ACT Composite > 25) , . undecided freshmen^ coning from two 
entering class cohorts, were used in the study. One group 
was included in the new program; the other was advised in 
the traditional manner. The results of the study were mix- 
ed, depending on the criterion of choice. Given the select- 
ed priors and loss function,' analysis with first-year drop- 
out rate as the Criterion was supportive of the program, 
whereas analyses with the other ciriteria were, not. 



% IJTHODUCTIOH 

An alternative to traditional student retenticrn re- 
search is to examine the impact of specific institutional 
interventions. A special advising program, developed at The 
University of Iowa, is such an intervention. 

Pr^yiouS research done at the University indicated that 




first enrolled, graduated at a lower rate than tfiose who did 



(King B Geiger, 1979; King 8 Gressarjd, 1979). These "unde- 
♦\cided*. students, however, were not shown to differ from 
their peers in ability, as measured by ACT scores* (King 6 
Geiger, 1979). This research 'led to the as^unpt^qn that, 
many, capable students were dropping out of. college due tA 

unfocused academic, plans,. Conseguently, ^he university a*- 

? • « * * 

veloped the special advising program for students who ar,e 
undecided about their major field of study (Silbers, 1979K 

The special undergraduate advising program relies on 
the efforts of a staff of specially-trained*, academic advi^ 
sors. These advisors are familiar with University policies/ 
* regulatiqns, and academic reguirem'ents. They are also fa*-. 

iliar with the use and interpretation of. students* back- | 

•) . >* * 

ground information, .such as apademic -achievement, test v 

> ' " c 
scores and interest inventory results*. 



♦ Through 1978, University practice was to,, more or less, 
randoaly assign undecided freshmen to faculty advisors it) 
various departaents. Although these faculty nembers were 
generally available to the students, it was the students 1 
responsibility to make the contacts. 

Cn the other hand, with the^ beginning of the undergrad- 
uate advising program in 1979, undecided students were' as- 
signed to the specially^trained; academic* advisors. The 
special advisors w.ere able to initiate frequent contacts 
with their advisees* and, in essence, give thea aore atten- 
tion thaUt; undecided students received- in the past. An un- 
tested assuaption of the new* program was that the frequeiyfc, 
,# guality , \contacts with acadeaically ^able, undecided stu-r 
1 dents would h^p crystallize their acadeaic plans and keep 
thea from dropping out. Additionally, it was hypothesized 
that these^ students would? show, iaproved classrqom perfor- 

'- . [ 

aance. / 

.V - ; 

. the purpose of this study was to assess the effective- 

nessrof the undergraduate advising program for hig-h-ability 

7 ' ' ' , * • 

fr*shaen with undeclared majors, undeclared students of j~ 

J\ 1 • - i • 

'high ability were singled dut because, presumably, they .were 

performing less* well and perhaps dropping out fot reasons 
other than inability to do college-level work. Three dis- 
tinct, quantitative criteria were used to partially evaluate 
the effects of the program for this group of- students: 
first-semester dropout ^rate, first-year dropout rate, and. 



f irst-seafcster grade* point average (GPA) • Ficst-seaester 

j \; 

dropout rate-was de£in£d as the ratio &f students not en- • 
rolling for their s&cond tern to the total nuaber of stu- 

■ . " ' \ ' ' 

dents in the entering^ class, Jirst- year dropout rate refer 
red to the ratio of gte^flients not enrolling for the.s^art of 
theit second year to th^totaj. number of students £n t % he.co 

hor,t«r First-seaester GP^ was siaply the GPA s maintained' by. 

r \ ^ , ' 

the cohort at the end of 1 1*6 . first seaes ter* ; 



.1 



V . f 



•PBOCBDDBES 



Two samples of students mere available. They were, 
\ *.•■»•- - - ' ' ' 

respectively, all undecided freshmen in t"he" Fall 1978 and 

Fall 1979 entering classes. The Fall 1978 group .served as 
the untreated sample (those not included ^in the special ad- 
vising prograa) and the Fal^ i979 group served , asT tfre treat- 
ed sample (those included in the prograa) . Since I was par- 
ticularly interested' in ^the effects of the program for' 
high-ability, undecided students/ only those with ACI Coapo- 
site scores greater than' 25 were' included in each saaple.' • 
This represents approximately the upper 25* of the undecided 
students for each year. In all, 163 students were in the 

1978 , saaple and 1#1 .students were in the t979 „saf pie . 

*■ . ' — * 

* f In 'ordejc to conduct the following analyses, I assumed 

that the classes were random samples from two different,^ but 

similar populations, v with« the primary difference being the < 

influence of the special advising program. In reality, how- 

ever, this*. assumption is violated to some extent.' Since 

'1974, data for all entering students sugge^t^that f irst^sem-' * 

ester and first-year dropout' rates have decreased , by a lit- 



• i Based on data for 1974-1978 froa The. University . of Iowa, 
Begistrar's Office, Spring, 1980. 
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tie less than one percent a year.* Grade point averages have 
increased slightly, over this sane period of tine. * ■ Obvious- 
ly, there an assumption violation apparant in thqse data 

that, will nake interpretation more difficult. 1 However, it 

7 

was considered and dealt with, to the extent possible, ,i? 
the 'Evaluation of 9 Results section. 

A 

Bayesian data analytic procedures were applied in an 

analysis with each of the 'three criteria of interest. Thus, 

three separate analyses were actua'lly conducted. Bayesian 

technigues were used to take advantage of considerable prior 

knowledge about characteristics of entering class cohorts at 

« 

„The> University of Iowa. 



« Based on data for the Fall senesters of 1975-1977, ob- 
tained from Suaaaty Reports 51, 55, and 59 of The Univer- 
sity of Iowa, Evaluation and Examination Services 



f • e AHALISIS I - FIRST SBHESTBR DBOPCUT BATE 

• "* 

<r * * 

First-semester dropout rate,, for both the "treated" and 
"untreated" groups, is assuaed to be distributed binomial! y 
with parameter, Tf- # ! 

££isi JJisisiJiajtions 

EliisjiJt asftisiis aJyisina £i2flMa-. 

The overall dropout rate for freshien at The University 

^ ' I . . < > * • 

of Iowa is about .07, prior toj the start of the second sea-. 

ester^' It is also knowff that, prior ta 1979, undecided stu- 
dents dropped out at a higher/ rate than declared aijors («10 
vs* #06), and that high-ability st;u^lentCy ('»CT Comp # > 25> 
dropped out at a Tower' rate than other 'st'udents (.03 v;s. 
♦ 08) ♦ Considering all of this inforaatioTt, it was 'believed , 
.that the first-seaester dropoutvrate for high-ability*, unde- 
cideft freshmen, who have not been included in the undergrade 
uate advising -program, "would be about* .07. This figure re- 
fleets the overall drdpout* rate. with roughly offsetting 
influences due to the undecided <«!0) and high-ability (#03) 
characteristics of the defined population. 



* ibid . * . 9 



Based on ay, confidence in these figures, a prior 
distribution for the true dfopput r4Ae was selected. This 
.prior was a beta, with parameters 5 and 60, a median 'of .07, 
and a SOX highest-densi ty-'region (HDR) credibility interval 
of <. 04,-09). Thus, it Was believed that the true value <h 
the dropout rate for undecided freshmen, not' in the special 
program, had a 50-50 chance»of falling between .OH^antf .0^. 
This estimate was regarded, as equivalent to 65 sample obser- 
vations. See the first column of Table'-lv for further char- 
acteristics bf this drior. 

• • ■ ( 
'• -i'' ' ■ 

Insert Table. 1 about here. . 



Miih asaisiis ftiiisiaa sisaii*. 

The special* advising prografc introduces another factor 

into the creation of the prior distribution the ^flu- 

ence, o*f the program itself. , Playing the role of an .advocate 
for t^e program, I believed that the program, together with, 
the previously discussed downward trend fe over time, would re- 
duce # the dropout rate of high-ability^ undecided fre'shmen 
from .07 to- .0<4. * 

My prior distribution i(or jthe true dropout tate of the 
"treated" 'group was/3(1.5, 32.5) with. a nedian of .04 and a 

50X HDR of (.01,. ,04). "This estimate was ^regarded as eguiv.a- 

' * ' r 

lent to 34 sample ^observations (see Table 1) . 



,0f the 163' higfh-ability , undecided students in thfe 1978 
class, 11 dropped out prior to the start of their second 
jsenester. The observed dropout rate for the "untreated" 
group, then, was *07. Thiis # the posterior distribution* for 
this "-group, based pn »y prior' expectations and'the observed 
dffopout rate, Mas 16, 2 12) with Bean, nedian, and'mode all 
equal to .07*, and 50X HDB ranging f'ron .06 to .08. Further 
characteristics of this posterior beta* distribution are 



shown v JLn the second coluan of Table 2. 



Insert TabJL^ 2 about here 



Cf . the 181 students in the 1979 Sample, 9 were classic 

fifed*as dropofuts, yielding a f irst-senes ter dropout rate of 

.05. Consequently, *the. posterior distribution for the 

treated group was '/£(10.5, V 204.5),. This distribution has a 

»ean -and nedian of .05* and 50% HD'R of .04 to .05. Coipari- 

( son of thj^Rosterior distributions -for the two ■groups' sugv- ' 

gestred that the probability of a true diff erence between 

drdpout rates for the treated and untreated students was 

about .83 (Table 2). Or, iq otfier words, the probability is- 

/ .87 that the dropout rate is lower for the specially-advised 
* 1 " • . n 

group than for the tTaditionally-advds^d group. * 



AIALISXS if - FIBST IE$B 'DBOjd.OT RITE 

* ^ 



First-year dropout rate, for fcoth the •JtreaAed" and , 

' . • v . , 

"untreated 1 ' groups, is assumed to' be distributed binonially 
with parameter, • - • 



gUfcaai asaiaiis a^isiia fiisaifli* 

The overall dropout "rate for freshaen at The Ondversity 

of Iowa is about .20, prior to the start of .their seconci 

>, * - * • 

a ' * • . # 

year.* Although little was Jcnown about the specific dropoyt 

¥ rates for higfr-ability or undecided students, I be-Heved 

that the logic applied in Analysis I would also % apply^ her^ 

In other wor'ds, the relatively high, dropout rate associated 

with undecided -students and tiie low dropout rate for high-a- 

bility students would provide Roughly of f setting influences. 

* * v • * 

Thus, the fiijst-year dropout rate* for higji^afcility'/ fandecid- 
ed fresbien, who have not bfeen included in the undergraduate 
advising program, Mas believed to bfi about the 4 sa»e a$ the 
rate for, all students about .2Q. ) 

y 
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Easea on this belief, a prior distribution was chosen 
for the true firs't-year dropout rate; This prior was beta 
with parameters 9 j&rtd 35, a median ot .20 fc and a 50% HD9 
ranging from .15 to .23. Thus, I believed that the true va- 
lue of- the first-sear dropout rate for high-ability, ■ unde-* 
•cided students, not in the special program, had a 50-50 
chance of falling between .15 and- k 23. This estimate car- 
ried the weight of U<* £ja»ple observations* Further charac-^ 
te^istics of this prior are^ presented in the first column of 
Table 3. ' . • 



Insert Table 3 about here 

J 



litk asfl3aels a^iiaAaa iiaaxai- v ' "X 

Again playing ttie role of aa advocate for the progran, 
I believed that the prograp - together with the previously, • * 
4iscussed downward trend in drppput tat€ over tile - would 
reduce the first-year dropout rate of high-ability, undecid-\ 
ed students from .20 to .15. Hy prior for' this "treated" 

-group, then, was /S( 5, 27) with a median of .15 and a 50* HD§. 

.'of (#10,.18) # This estimate was regarded as equivalent to 
32 sample observations (S€te Table 3)'. % 

/ 



1 ■ 
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..ffw^nty-six of the 163 students,, included in the 1978 

• [.».. . " - 

sample, propped out prior* to th*e start of their second aca- 



x deaic year* 'thus, the observed, first-year dropout rate" for 
the untreated sample was .16. The resulting posterior dis- . 
tribution, then, was >0(35, 172) , with nean, aedian, and aode 

, * * * * f 

•of .17 and-501 HDH froa .15 to .18, as shown in Table 4. 



Insert Tafele 4 about here % S 



Of the 181. students in the 1379 safaple, 21 dropped out, 
yielding a first-year', dropout rate of .12. Consequently, 
the posterior^distributiou for the treated group was beta * 
with paraiete^s, 26 and 187. The lean, aedian, and aode of 
this distribution are all egual to .12, and the 5051 HDH ex- 

• v s 

tends froa .10 to .13. . Coaparison of the posterior distri- 
butions for each group indicated that the probability of a • 
true difference between the dropout rates for the treated 
and untreated students was about .91 (Tafele 4)*' 



er|c 
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, • 1H1LISIS III - FIBST SEHBSIBH 6P1 " r 

* - * 

Mai :> ' 

Firit-semester collegte GPA, for both the •treated 1 and 
•untreated 1 groups, is assumed to be distributed normally 
Kith lean, <o ; , and variance, <JJ* . 

<• ■ *• 

glltoai asadsiis aSiiaijea biasim- . • » 

The mean f irst-semester GPft fcr ,freshmen at The Univer- 
fixity of Iowa -is" about 2.65.* It is known that undecided stu- 
dents, do slightly less well than declared majors <2.tf0 vs. , 
2.65) , and. that; high-ability students^^CT Composite > 25) 
perform t better on the averacfc than other students (2*95 vs. 
2.H5). Considering all of this information, it was believed, 
that mean GP* for high-ability, undecided freshmen, who have 

not been included in the undergraduate advising program, 

• • « 

would be about 2.80. This figure reflects the approximate • 
•overall GPA, modified by the influences due to the undecided 
(2.60) and higl)-abiLity (2.95) characteristics of th^ de- 
fined population; 



* Based on data for the Fall semesters of 1975-1977, ob- 
tained- from Summary Reports 51, 55, and 59 of The Univer- 
sity of Iowa, Evaluation and Examination Service. * 
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The average standard deviation of first-semester cfpA, * 
over 'the last few years, is about 0.75.« No difference in 
standard deviation between undecided students and declared 
^ajors is evident. However, since the assignment of stu- 
dents to groups based on ACT scores has the tendency to res- 
trict the range on ability, it is^not surprising that the • 
std. deviation of GPA for both the high- and the low-ability 
groups is less than 0.75. Host important for this study is 
tdatf the population of students with ACT composites greater 
than 25 have a standard deviatiQn (or) of about 0.70 for * 
first-se«esler GPA. Since whether>students-are undecided or 
not -seeis to have little bearing on <r ,~it is believed that <r 

for high-abilitj, u&tiecided freshmen is' also 0.70. 

- * 

Hy prior marginal distribution on |he standard devia- 
tion was. fit to an inverse chi with 19 degrees of freedom 
and scale pa-raaeter, 3. OK . This distritution has* a median 
of 0.70 and a 50% HDR of (0.60,0.75)^- Thus, I believed that 
the true value of. the standard deviation had a 50-50 chance • 
^°. f falling between 0.60 'and 0.75. This -estimate was regard- < 
ed as the equivalent of 20 saaple observations. See the V 
first coluari in Table 5 for further characteristics -of this 
distribution. ' - 



Insert Table 5 about he-re 



*• Ibid 
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Given <r =0.70, ray ,pr,ioc conditional distribution^ for 
the population mean is Centered at 2.80, with a standard de T 
viation of 0/1 J. This estimate, is the equivalent of* 25 ob- 
servations. : * \ 

Finally, ay prior uarginal distribution* on the nean was 

.a ^-distribution 'with 1$ degrees of freedon and scale param- 
eter, 0.36. It has nean f median, and lode cf 2.8, and a 50% 
&DR extending fron 2.71 to 2.89. Thus it was believed that 

.the true value of the nqan GPU for high-ability, undecided 
freshnen, not in the special program, had a 50-50 chance of 
falling between 2.71 a*d'2.89 (see column 1, Table 6). 



Insert Table 6 about here 



Siii asa&Bis aiJiisina fiioaiaj. 

v v * 

.Playing tire .role of an advocate for the prograa, 1 be- 

- lieved that jtke program, along with the previously discussed 
upward trend in GPA over ti»e, would inprove aean GP A Qf 

* 9 

- higTi-ability , undecided students from 2.80 tc 3.10. 'This 
change was not believed to affect the standard deviation, so 
the prior airginal distribution On <r was inverse chi ( 

With 19 degrees of freedom and scale parameter, 3.01, as de- ^ 
scribed earlier. (Table 5) . t ^ 

• fly prior conditional distribution for the population 
aean* given T =0.70, has mean, 3.10, and staqdatyd devia- 
. tibn, 0.15. This estimate was regarded as the equivalent of 
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20 observations. \ • 

\ * » * ' 

The Wior « a rginal distribution on the wean, then, was 

found to bfe £(.19,0.45). It has mean, median, and mode of 

V ' ft 

3.10, a standard deviation of 0.16, and a 50* HDB fro« 2.99 
to 3.21 (Tab^e 6) . 

*or the untreated (traditionally advised)* group of stu- X 
dents, the observed aean was 2. v 92 with standard deviation, 
0.79. .The posterior distribution on 0" for the untreated ' 
group, then, was ^"'(178, 10.38) with median, 0.78, and 50* 
.HDB ranging from 0.75 to 0,80 (Table 5). By posterior, mar- 
ginal' distribution on m was ^ with 178 degrees of freedom 
•and scale parameter, 0.59. ' This distribution has a Sean of 
2.90 and a 50* HDB 'from 2.86 to y 2.94 .(Table 6) . 

V 

The' observed mean for the treated (specially advised} 
•students was 3.02 with standard ^deviation cf 0.61. Conse- 
guently, my posterior distribution on the standard devia- 
tion, for the treated group, was XT'cm, 8.63) with a aedi- 
an of 0.62, and a 50fy HDH of (T.6Q to^0.6<* (see Table 5). 
The posterior, marginal distribution on A was t with 191 
degrees of freedom, paraaeter, 0.3*8, lean, 3.03, and 50* HDB 
extending fron 3.00 to 3.0^* (see Tfrble 6). 

The standardized posterior distribution foc N S (where * 
is the difference between the. treated population and un- 
treated population Beans) is a Behrens-Fisher distribution 



■18 \ 



1* 

with 194 and 178 degrees of freedom, a_nd angle, ^ =37.55*. 
Use of the Behrens-Fisher to compare the two posterior dis- 
tributions • of the neans indicated that thfe probability of a 
true' difference, between the treated and untreated students^ 
was about 0.96v (Table 7). The mean value for s is 0.13 with 
a 50* HDR extending from -ft. 07 to 0*17. 

7 

f T- 

Insert Table 7 about here* 
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% • 1 DISCOSSIOI. 

The results'of all three analyses were Evaluated using 

a th resold loss function* *»ith this approach, the deci- 

sion, regarding the success ot failure of the special advis- 

ing prograa, is*aade so as to aiiuaize the expected loss 

(net cost to 'students, the university, society, etc.) due to 

an incorrect decision* 

K "2 x 2 layout is shown in Table 8 to represent the . 
* *■ * 
possible outcomes for each decision* Pour outooaes were 

1M ■ » • i- 

possible. - 

1. Decide to keep the prograa when, in fact, the prograa 
is ineffective (false positive) ; 

2. Decide to keep the program and the program is truly 
effective (correct decision) ; 

3. Decide to discard the program /When the program is 
truly not effective (correct* decision)'; 

U. Decide. to discard t&e, prdgraa when, in fact,. the pro- 
graa is really effective (false negative) • 
A loss Lb associatetTwith each of these possible outcomes* 
However, the loss is zero for the two cells reflecting por- 
rect decisions. 



- 17 - 




18' 

An expected loss foreach decision caj),then be found by 
aultiplying the assigned loss of the appropriate -cells by \ 
probability of occurrence, - and then soniing the cell pro- . 
ducts. The "best" decision is that which finiarizes expected 

lOSS* ; V 



Insert Table 8' about here 



: in o^der to .proceed, the following judgements were re- 
quired: „ , . . 

1. The loss to be assigned fpr a f<Use positive-^); 

2. The loss to be assigned for a false negative (B) ; 

.3* A Meaningful criterion of s the advising pcograa^s suc- 
\ 

cess (c w ) ^ 

In Table 9/ %,, X", the loss assigned for keeping an inef- 
febtive progra*, was given a value of 5c units* 7 This value 
is based primarily on estimated operating costs of the pro-^ 
<jraa < (about. $200,000 annually in salaries, office space^ 
etc.) . % ' __ 



Insert Table 9 about here 

* : — 1 



7 No understanding of the specific value of these units is* 
required. They need be evaluated only as relative to the 
loss units assigned for ofcher outcoaes. " 
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m B n vas gUen a iralue^Qf 3t ^ucits^. which reflects the 
loss due to discarding a truly effective program. The esti- 
■cite of: "B", was ba)sed primarily on the^ssuied loss tp the f 
University, society, 'and the students' themselves, when °V 
bigh-a^ility students drop out. without receiving the bene- 
f its, of the program. Other factors Considered in the valqe 
of "B" were: 



1 1 . *the increased load for regular faculty advisors, 

should the special 1 program be disbanded; an-d ' 
. 2. the decreased liklihood of restarting the ; (effective) 
program after it has been once tried and discarded. 

> s ■ - 

Although the' weighting of this loss function can certainly 
be argued, it seemed pla,usibl% and was used for evaluating * 
the obtained results. ^ 

Since the three criteria are expressed in' different 
units, the value of c*, of course/ Should not be exacted 

to be the saie for all three analyses. However, the sale 

" ' 
value (#03) vas selected for Analyses I and II. ^ This value 

reflects the Minimum acceptable difference in dropout rates^ 

for the two samples. . It represents the retention of 3-U 

high-ability students per year, even after accounting for *' 

the effect of a possible independent decline in arqpotit^ rate 

from 197* to .1979. : ' \ t * *: 

In Analysis III,, c* reflects the minimally* acceptable \ f 

'difference in wean GPA, judged to be 0.15. Thi& represents " 

th^ seemingly small increase of only a fraction *x>£ a sjtan**-' 



I* 



f ■ 20' 

dard 'deviation. However,, it seems qijite possible that the 
advising prograa will not be bejiefici^l to certain students 
who are already Capable of ' handling s^ne uncertainty . in 
their academic plans. These students, then, aay not be ex- 
pected to contribute to an ioproved aean GEA , and any in- 
proveaent that i<s noted will likely be due to the reaaining 
students* Thij^, it may be that an- iaproveaent in aean GPA 
of 0.15 could represent a very substantial increase for soae 
of the^students. ' 

Tables 10^ 11, and 12 present the application of th-e - 
loss function' to evaluation of tfce results froa the three 
analyses. Following the decision' rule described in Table 8, 
the analyses based on first-semester- cri teria (dropout rate ' 
and grade point average) indicated that the "best" decision 
was to drop the program (Tables 10 and^12, respectively). 
On the other hand, the analysis based on first- x£$r dropout 
rate yielded support for the>l prograp (Table 11). This sup- 
port & tenuous, thought since ay priors were based on "an 
advocacy position for the program. If a skeptical Universi- 
ty. -ad«inistrator does not share „ny beliefs, even this sup- 
port dissipates. 5 v 



Insert Table 10 about here * 
— «3t '■ / 



Insert Table. IKaiout "here 



•Insert Table 12 about here * * f* 

i 

\ _ — _ 

Clearly, these outcomes are dependent upon more than 

just the saople r data* The priors f4r the treated group- and 

th* loss functions involve value judgements that* could have 

^ • 

been^such so that ea'ch* decision would have been reversed* 
However,* given tny priors and lo^s function as they were/ oije 
of three analyses supported continuation r o£ the undergradu- ' 
ate advising program. 



Hhen the mixed results of the three analyses are viewed 

^together, the cumulative results sees to ajgue against the 

v 

program. However, since the program is already in place and 
since the analysis with first-year drcpodt rate was suppor- 
tive, further research could be ..helpful. Specifically, a 
similar an&lysis* with 'second semester GPk as the criterion, 
could shed father light on the effectiveness of the program 
for high-ab,ility, undecided students. Perhaps the effects 
of the new advising program are not~£ully seen until the 
second semester of the , freshman yearv Ihis kind of delayed 
effect could explain* why the program Wfcs° supported when 
'first- isnr dropout rate< was used as the criterion, but not 
/when either'of the first-semestex- criteria were used. 



• Certainly, ■ the criteria considered in this study are/ 
only three of aany possible criteria for evaluating the pro- 
'graa. A complete evaluation nould have- to include other po- 
pulations of students as well as other criteria. But to the 
^ex£ent that the undergraduate advising, program ca^p be viewed 
as successful it represents a £>ost-enro lltent intervention 

the University that can have an effect on. student perfor- 
mance and/or retention': Future research , together with, the 
resaits of this study, may indicate that there is" .so Be ad- 
ainistrative utility' in offering the prograa. Butjfroa 
another perspective, the magnitude of the effects noted 
this study -.likd in much other retention research - appeafs 
to be quite- Ion* Stud'ent retention remainfe an elusive pile*- 
nonenon, • 
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